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Abstract 

We present the Progressive Second Price auction, a new decen- 
tralized mechanism for allocation of variable-size shares of a resource 
among multiple users. Unlike most mechanisms in the economics lit- 
lerature, PSP is designed with a very small message space, making 
ii suitable for real-time market pricing of communication bandwidth. 
Under elastic demand, the PSP auction is incentive compatible and 
stable, in that it has a "truthful" e-Nash equilibrium where all players 
bid at prices equal to their marginal valuation of the resource. PSP 
is economically efficient in that the equilibrium allocation maximizes 
total user value. With simulations using a protype implementation 
of the auction game on the Internet, we investigate how convergence 
limes scale with the number of bidders, as well as the trade-off between 
engineering and economic efficiency. We also provide a rate-distortion 

•Parts of this work were presented at the S"* International Symposium on Dynamic 
Games nnd Applications, Maastricht, The Netherlands, July 1998, and at the DfMACS 
Work:shop on Economics. Game Theory, and the Internet, Rutgers, NJ, April 11»9T. 
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theoretic basis for valuation of bandwidth, which leads naturally to the 
elastic demand model that is assumed in the analysis of the mechanism. 

Keywords: resource allocation, auctions, game theory, mechanism 
design, network pricing. 

1 Introduction 

Communication networks aie characterized by what economists call exter- 
naJities. The value a user gets from the network depends on the other 
users. The positive externalities are that a communication network is more 
valuable if more people are connected. The negative externalities are that 
resources are shared by users who - because of distance, population size, or 
selfishness - cannot or wiD not coordinate their actions sufficiently to achieve 
If J the most desirable aUocation of resources. The recognition of this reality in 

m many aspects of networks and distributed computations has lead in recent 

m years to the emergence of game theoretic approaches in their analysis and 

design (23, 9, 25, 33, 15, 16]. 
hi Prices, whether they relate to "real money" in a public network or 'Tunny 

r\l money" (based on quotas) in a private system, pl^ a key role as allocation 

fil control signals. In the former case, this role is of course intimately tied to 

r: another, which is to allow a network provider to remain- in business [7]. 

Cl The telephone system and the current Internet represent two extremes 

II! of the relationship between resource allocation and pricing. The resources 

allocated to a telephone call are fixed, and usage prices are based on the 
ill predictability of the total demand at any given time. On the Internet, the 

O current practice of pricing by the maximum capacity of the user's connection 

h^- (flat-rate pricing) decouples the allocation (actual use) of resources from the 

prices. 

In the emerging multiservice networks (ATM, Next-Generation Inter- 
net), neither of these approaches are viable. The former because of the wide 
and rapidly evolving range of applications (including some which adapt to 
resource availability) will make demand more difficult to predict. And the 
latter because, once the flat fee is paid, there are no incentives to limit usage 
since increasing consumption benefits the user individually, whereas limiting 
it to sustainable levels brings benefits which are shared by all. This makes 
it vulnerable to the well-known "tragedy of the commons". With flat pric- 
ing alone, the tendency is toward increasing congestion which chases away 
high-value users, or increasing prices which exclude low-value users [6], in 
both cases leading to decreased network revenue. 
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Thus there is a need to develop new approaches to pricing of network 
resources. Among the requirements are: sensitivity to the range of resource 
requirements (either through a sufficiently rich range of traffic classes which 
are priced differently, or by allowing users to explicitly quantify resource 
requirements); prices must be dynamicaUy responsive to unpredictable de- 
mand (market based system); perhaps most importantly the pricing archi- 
tecture should constrain as Uttle as possible the efficiency trade-offs of the 
policies. 

Indeed, the fundamental issue in designing pricing policies is the trade- 
off between engineering efficiency and economic efficiency. This tradeoff, 
which is more or less constrained by the underlying network technology, has 
many dimensions, including: 

• how much measurement (from usage to capacity pricing), 

• the granularity of differently priced service offerings (e.g. number of 
traffic classes), 

• the level of resource aggregation - both in time and in space - at which 
pricing is done (per packet/cell or per connection, at the edge of the 
network or at each hop), and 

• the information requirement (how much a priori knowledge of user 
behavior and preferences is required/assumed by the network in com- 
puting prices). 

An approach which achieves economic efficiency is the smart-market ap- 
proach of [19], wherein each packet contains a bid, and if it is served, pays 
a clearing price given by the highest bid among packets which are denied 
service (dropped). This approach is incentive compatible in that the optimal 
strategy for a (selfish) user is to set the bid price in each packet equal to 
the true valuation. Each node in the network becomes an efficient market, 
but the engineering cost (sorting packets by bid price, as weU as per-packet 
and per-hop accounting) could be significant if line speeds are high relative 
to the processing power in the router. In (14), users are charged according 
to a combination of declared and measured characteristics of traffic. By 
taking an equivalent bandwidth model of resource utilization, and assuming 
appropriate traffic models, a menu of pricing plans indexed by the declared 
traffic can be offered which encourages users to make truthful declarations 
(e.g. of the mean rate), and also encourages the users' characterization ef- 
forts to be directed where they are iiiosl relevant to the network resource 
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allocatioii. As the pricing is relative, [14] does not aim to address the prob- 
lem of determining the actual monetary values of the market price (that 
users would be willing to pay). Another pricing scheme which incorpo- 
rates multiplexing gain is formulated in [12], These and a number of other 
schemes are summarized in [11], in a comprehensive view of the connection 
estabUshment process, which identifies the user-network negotiation as the 
key "missing link" in network engineering/economic research. In terms of 
our taxonomy of the previous paragraph, this is part of the information re- 
quirement trade-off. Indeed, in the absence of formal mechanisms to deal 
with the information problem, complex and (at least intuitively) undesirable 
things happen. For example, some providers offer expensive "front of the 
book" rates to uninformed customers, and lower "back of the book" rates to 
informed customers who may be about to defect to another carrier (see [7] 
j and also the recent wars between AT&T and MCI in consumer long-distance 

m service in the United States). In [34], it is argued that architectural consid- 

Jl? erations such as where charges are assessed should take precedence over the 

jf pursuit of optimal efficiency, and edge pricing (spatial aggregation in terms 

hi of our taxonomy) is proposed as a useful paradigm. 

Ill In this paper, we propose a new auction mechanism which accommodates 

III various dimensions of the engineering-economics trade-off. The mechanism 

applies to a generic arbitrarily divisible and additive resource model (which 
Cl may be equi\'alent bandwidth, peak rate, contract regions, etc., at any level 

111 of aggregation.) It does not assume any specific mapping of resource allo- 

ts cation to quality of service. Rather, users are defined as having an explicit 

ill monetary valuation of quantities of resource, which the network doesn't or 

O can't know a priori. Thus, in terms of our trade-off taxonomy, this mech- 

anism aims for unlimited granularity, flexibility in the level of aggregation 
and minimal information requirement. 

In the most likely auction scenaria, users would be aggregates of many 
flows data flows for which bulk capacity is being purchased for e.g. Virtual 
Paths, Virtual Private Networks, or edge capacity [2, 31]. 

We begin in Section 2 by formally presenting the design of our Progres- 
sive Second Price auction mechanism for sharing a single arbitrarily divisible 
resource, and relating it to classical mechanism design from the economics 
litterature. In Section 3, after describing our model of user preferences 
and the elastic demand assumption, we prove that PSP has the desired 
properties of incentive compatibility; stability, and efficiency. The section 
concludes with simulation results on the convergence properties, and the 
efliiciency trade-offs. Appendix A describes an information theoretic basis 
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^..^o^ of the type .h.. ^ »».ned .he ^^,=is of Section. 3, as 
one possible justification. 

2 Design of an Auction for a Divisible Resource 

2.1 Message Process 

Mowi^ 1361, i. is U. expose XT^i.'T^^T^:^^'^^ 

TeaJtoatioB, where a message process f^""'^r^^^iou nJes aie de- 

damental choice which wiU constrain *^^«;^^_^^;^*3^nf scalabiht^ in a 
Our first concern here is with engmeering. ^'^''^^.^l^^^^^ niessages 

network setting, we shafl ^^^^Z^^r^^^ '^^^^^^ - 
aie as small as possible, while st^ 6 j^^^^j. 

resource aJlocation and pricing to be performed J^f^^^^^f Computation 
edge of demand (market research, etc.); and b) the amoun 
at the center is minimized. . slavers I = {1, • • • J)' 

Given a quantit, Q of a resourc:e^d -;*1^^7J^«i,g\ids, i.e. 
an auction is a mechanism consisting of. D ^'^^^^ they are willing 
^daring their desired share of the total resoi^ce^^^^^^^ 

to pay for it, and 2) the auctioneer allocatmg shares 

players based on their bids. _ meaning he would like 

Player i's bid is Si = (quPi) € 5, - [0, gj x u, Following 
a quantity at a unit price p.. A bid P-«« - ' .^^^ . . i.e. 

standard game th-retic notation let .-.^^^^^^^ 

^--'^ - - 

write the profile a as (s.-; 

The allocation is done by an allocation rule A, 



5 — 5 
s = iq,p) — ' >4(5) = (a(s),c(5)), 



where 5 = niel*^'- . _ , , , the allocation to player 

The i-th row of A{s), Ai{s) - (aAshcAS)h ^ ■ 

i, she gets a quantity a^.) for wUd, she .s charged c,(.). >ote P 
price per unit and c is a total cost. 
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An aJlocation rule A is feasible if V5, 

i€l 

and Vi € I, 

o,(s) < 9«, 
c.(s) < Piqi- 

Remark a- The above formulation is a generalization of what is usually 
meant by an auction. The latter is the special case where 0^(5) = C? for 
some winner ^ € J and a,(.) = 0, Vi # w, i.e. the sale of a single indivisible 
object to one buyer, for which the theory is well developed [22 24]. In our 
approach, allocations axe for arbitrary shares of the total available quantity 
of resource. Equix-alently, one could sUce the resource into many small units, 
each of which is auctioned a. an indivisible object. But in a practical imple- 
mentation of auctions for sharing a resource, a process of tiddi^ig for each 
individual unit Avould result in a tremendous signaling overhead. More im- 
portantly, since the users would be bidding on a discrete grid of quantities, 
analytical predictions of outcomes could be misleading since they could be 
sensitive to the particular choice of grid^. . t. 

Remark b: Most of the mechanism design literature m Economics 
makes use of the following "Revelation Principle": 

Given any feasible auction mechanism, there exists an equivalent^ 
feasible direct revelation mechanism which gives to the seOer and 
all bidders the same expected utilities as the given mechanism. 
([24], Lemma 1) 

In this sharing context, a direct revelation mechanism would be one where 
each user message consists of the user's type, which is the valuation of the 
resource over the whole range of their possible demands, i.e. a function 
0- • (0 Q] - [O.oo), and the budget (see Section 3.1). A consequence of 
revelation principle is that the mechanism designer can restrict her atten- 
tion to direct revelation mechanisms, find the best mechanism m terms of 

>For a more detailed discussion of this point, see [4] p. 34, and references therein. 

'By equivalent, in [24] it is meant that, at some equilibrium, all players get the same 
utility. There may be other, possibly ill-behaved, equilibria. 

'The valuation of a given amount of resource is how much the user is willing to pay for 
that quantity. The inverse of the valuation is the user's demand function, givmg a desired 
quantity for each price. 
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her (economic) efficiency objectives, and then - if necessaiy - transform it 
into an eqtiivalent, mechanism in the desired message space. This is conve- 
nient because one can exclude the infinitely many mechanisms with larger 
message spaces, without fear of missing any better designs. The design pro- 
cess is usually the solution of an optimization (mathematical programmmg) 
problem. For this reason, in the litterature, mechanism design problems are 
mostly solved for cases where the space of users' types is one dimensional, 
or at most finite dimensional [21], using message spaces that axe of the same 

dimension. , . ^- r 4. 

In our sharing problem, the conventional approach is unsatisfactory m 

two ways: 

• First, a user's type is infinite-dimensional, as we do not restrict the 
valuation functions beyond some very general assumptions (see Sec- 
tion 3.1), and so the conventional "programming" approach of de- 
riving the mechanism from the revelation principle would lead to an 
intractable problem. 

. Second, the conventional (direct revelation) approach, even if it was 
tractable, implies that a single message (bid) can theoretically be in- 
finitely long, because it has to contain a description of the function 0i. 
Qearly, this is not desirable in a communication network, where sig- 
naUng load is a key consideration. For engineering reasons, we choose 
a message space that is 2-dimensional. Therefore, a given message can 
come from many possible types, so there is no single way to do the 
transformation from the direct revelation mechanism to the desired 
one. 

Thus, unlike most of the mechanism design Uterature, we will take a di- 
rect approach, where we posit an aUocation rule for our desired message 
space, and then show that it has an equilibrium, and that the design objec- 
tive is met at equilibrium'*. This is equivalent to guessing the right direct- 
revelation-to-desired-mechanism transformation and buOding it into the al- 
location rule from the start. 

40ur aim is to to show that we can use this smaller message space and still achieve our 
objective. 
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Figure 1: Exclusion-compensation principle: the intuition behind the PSP 
rule 



2.2 Allocation Rule 
Define, f or y > 0 

and 



1 + 



(1) 



Qi{y,s-i) = Urn Q.{v,^-i) = 



Q- J2 9k 



The "progressive second price" (PSP) allocation rule is defined as follows: 



Oiis) = qi^Q^{pi,S-i), 

Ct(*) = J^Pj[oj(0;5_.)-aj(5.;s-,)], 



(2) 
(3) 



where A means taking the minimum. 

Remark a: For a fixed opponent profile Qi{pi,s-i) represents the 
maximum available quantity at a bid price of p,. The intuition behind 
PSP is an exclusion-compensation principle: player J pays for his allocation 
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so as to exactly cover the "social opportunity cost" which is given by the de 
clared willingness to pay (bids) of the users who are excluded by I's presence 
(see Figure 1), and thus also compensates the seller for the maximum lost 
potential revenue. Note that this amounts to implicitly assuming that the 
bid price accurately reflects the marginal valuation tf< on the range [a,,^,]. 
In other words, by this rule the auctioneer is saying to the player: "if you 
bid (qi,Pil I take it to mean that in the vicinity of g.-, 9i can be approxi- 
mated by a line of slope p.." This is the (built-in) transformation from the 
direct-revelation mechanism to the desired message process discussed m the 
second remark at the end of Section 2.1. 

The charge a increases with a,- in a manner similar to the income tax m 
a progressive tax system. For a fixed opponent profUe imagine player t 
is increasing g., starting from 0. The first few units that player . gets will be 
taken away from the lowest clearing opponent (i.e. m = axgmm j{pj : aj > 
0}), and player t will pay a price (marginal cost) pm per unit. When 
reaches 0, the subsequent units that player i gets will cost him Pm' > Pm, 
where m' is the new lowest clearing player, the one just above m. The 
PSP rule is the natural generalization of second-price auctions (or Vickrey 
auctions). In a Vickrev auction of a single non-divisible object, each player 
submits a sealed bid. and the object is sold to the highest bidder at the bid 
price of the second highest bidder, which is what happens here if 9.- = <?,Vx. 
This is widely known to have many desirable properties [35, 24, 4], the most 
important of which is that it has an equilibrium profile where all players bid 
their true valuation. As we will presently show, this property is preserved 
by the PSP rule in the more general case of sharing an arbitrarily divisible 
resource, and this leads to stability (Nash equilibrium). The PSP rule is 
analot^ous to Clarke-Groves mechanisms (3, 8, 20] in the direct-revelation 



case. 



Remark b: When two players bid at exactly the same price, and tliey 
are asking for more than is available at that price, (2) punishes both of them. 
For example, if Q = 100 and si = (4,60) and s^ = (4,70), the allocations 
would be d = 60 A ( 100 - 70) = 30, and = 70 A (100 - 60) = 40. Smce 
the bid prices are equal, there is no "right" way to decide who to give the 
remaining capacity to. One could divide it equally, or proportionally to their 
requests, etc. For the subsequent analysis, it turns out it is simpler to not 
give it to either one (of course, it will be aUocated to the lower bidders if 
there are any). This is just a technicality since by deciding this, we ensure 
that it wiU never happen (at equilibrium), since the users will always prefer 
to change their prices and/or reduce their quantity. 
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Considering the computational complexity of PSP, a straightforward im- 
plementation would at worst, sort the bids in time /log/, perform (2) m 
lineal time, and (3) can be done in time P. Thus, the complexity of com- 
puting the allocations is 0{P). 

3 Analysis of the Progressive Second Price Auc- 
tion 

3.1 User Preferences 

Since the aUocation rule A is given by design, the only analytical assump- 
tions we make is on the form of the players' preferences. 
Player t's preferences axe given by his utility function 

m : S — > (-00,00) 

s I — * Ui{s). 

Player i has a valuation of the resource ^,(0,(5)) > 0, which is the total 
value to her of her aUocation. Thus, for a bid profile of a, under allocation 
rule A, player i getting an allocation Ai{s) has the quasi-lineax utility 

= <>,(a,(s)) - c(s) (4) 

which is simply the value of what she gets minus the cost. 

In addition, the player can be constrained by a budget 6, € [0, 00]. so 
the bid a, must lie in the set 

5f(ji-i) = {5ie5f :c.(s.;5_,)<6,}. (5) 

In the proofs of the following section, we will assume that users have 
elastic demand, that is: 

Assumption 1 For any i £X, 

• BiiO) = 0. 

• ffi is difffnntiable, 

• fl( > 0, non-increasing and continuous 

• 37.- > 0. v.- > 0, e'iiz) >o=>^v< ^M-) < ^•(^) - - v)- 
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The last item says that as long as the valuation is strictly increasing, it must 
also be strictly concave (with minimum curvature 7.). However, it is allowed 
to 'fatten" beyond a certain amount of resource. 

I\inctions of this (concave) form have wide applicability as models of 
resource valuation, and can be justified from the economic standpoint (di- 
minishing returns) as well as from information theoretic standpoint - see 
Appendix A. For examples of valuations satisfying Assumption 1, see Sec- 
tion 3.4 and Appendix A. 

3.2 Equilibrium of PSP 

The auction game is given by (Q, tti, . . . , «/, A), that is, by specifying the 
resource, the players, and a feasible aUocation rule. We analyze it as a 
strategic game of complete information [4]. ^ c./ ^ _ 

^ Define the set of best replies to a profile s_i of opponents bids: 3.- (s-,- J - 

{Si € Si{s.i) : «,(s,;...) > «,(5;;..-,),V.;- 6 Si{s.i)}. Let S'(s) = UiSi{s-i) 
A Nash equilibrium is a fixed point of the point-to-set mappmg b , i.e. a 
profile s € S'(s). In other words, it is a point from which no player will 
want to unilaterally deviate. Such a point is what is most accepted as a 
consistent prediction of the actual outcome of a game, and has been re- 
peatedly confirmed by experiments, as well as a wide range of theoretical 
approaches. Indeed, in a dynamic game, where players recompute the best 
response to the current strategy profile of their opponents, this it»ation 
can only converge to a Nash equiUbrium (if it converges at all). In addition, 
an important trend in modern game theory- is the development of learning 
models, and there too, it has been shown that Nash equilibria result also 
from rational learning through repeated play among the same players [13]. 

A more general (and hence weaker) notion of stability is the existence 
of an e-Nash equilibrium. Let the €-best replies be 5/(s_i) = {^t e Si{s-i) : 
Ti.(5.-; s.i) > ui(3^: s.i) - €,Wi G 5,(5_.)}. An €-Nash equilibrium is a fixed 

point of 5'. ., 
In a dynamic auction game, € > 0 can be interpreted as a btd fee paid 
by a bidder each time they submit a bid. Thus, the user will send a best 
reply bid as long as it improves her current utility by c, and the game can 
only end at an f-Xash equilibrium. 
Define 

Pi(z, 5_, j = inf {y > 0 : Qi(y, s.i) > z) . (6) 
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Thus, for fixed s-i, V», z > 0, 

z < Qiiy, s-i) =>y> Pi{z, s-i) (7) 

y> Pi{z,s-i)=> z<Qi{y,s-i). (8) 

The graph of Pf(.,5_.) is the "staircase" shown in Figure 1, and that of 
Qi{., s-i) is obtained by flipping it 90 degrees. 
It is readily apparent that 

Ci{s)= r^'^Piiz,s.i)dz. (9) 
Jo 

The key property of PSP is that, for a given opponent profile, a player 
cannot do much better than simply tefl the truth, which in this settmg me^ 
bidding at a price equal to the marginal valuation, i.e. set jh - ^{(ftj. ay 
doing so, she can always get within € > 0 of the best utility. 

it 7i = {si € Si : Pi = Biiqi)}, the (unconstrained) set of player i s 
truthful bids, and T = O* ^• 

Proposition 1 ^centive compatibility; Under Assumption 1, "ii € X, 
V5_- € such that Qi(Q,s-i) = 0, for any € > 0, there exists a truthful 

In particular, let 

Giis-i) = |z e [0, g] : z < Q.(«;(z), s-i) and Pi{v, ^-.) dv < ^} ■ 

Then with Vi = [sup - f/^KO)]"- '^nd Wi = B'iivi), U = {vi,Wi) € 

TiDSfis-i). 

The truthful best reply can be found in a straightforward manner, as 

illustrated in Figure 2. ^ ^ \ 

Proof: Fix s_. € S-i. Let 2< = sup G,(a-.) and y. = »,(z. j. „ . ^ 

By definition of z., 3{z(n)} C G.(s_.) such that lim„ z(n) = Z|. Hence 6.- > 
lim„rf<"^P<('7.s..)d»7 = So'PiiV,s.i)dr, > c<(t,;s.i). where the equality com« 
from the boundedness of and the Lebesgue dominated convergence theorem, and 
the second inequality from (9) and (2). Thus t, € T n5.(s-i)- 

*ActiiaUy. since Q.(..s-i) is upper-semi-continuoiis (jumps up), we have z < 
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Figure 2: Tnithful c-best reply 



Next we show that i, 6 Sf(«-,). First, Zi = Unon r(n) < lim„ Q, (fl<(2(n)),s..) < 
Q, (linv, «-»). where the inequalities follow respectively from r(n) € C?,(5-, ). 

and the upper semi-continuity of Now by the continuity of fl<, Qi(\im„ «i(*(n)).« 



Now, we claim that a.(<,; = Vf. Indeed, if z.- = 0 then v.- = 0 and a,(ti; «-,) = 0. 
Uzi > 0, then by (10), Q,(y,-,«_,) > 0 and since by hypothesis Q,(0,s-,) = 0, we 
have eiizi) = y, > 0. Also, z.- > 0 implies «, < z<. Therefore, by Assumption 1, 
we have w, = ^{(t;.) > 5{(zi) = W- Hence, since Q^(.,s-i) is non-decreasing, 
Q.iv;i,s.i) > lim,\, 0.(77,5-.) = Q.(y.,«-.) > ^ > Thus, by (2), 



Zi < Qi{yi,s-i). 



(10) 



(11) 



Now Vs.- € 5.(5_i), 



«,(*i;fi_.)-«,(jf) 
= <?,(o<(t.; s_.)) - tf,(a,(5)) - Ci(U;s.i) -I- f.(s) 





A-013 



> / [Pi{z,S.i)-e'dz)]dz-€ 



(12) 



where the inequality follows from (z.- - Vi) < f/fl;(0) and the fact that is 
increasing. Thus, it suffices to show that the integral is > 0. 

If Zi < o,(«), take any z € (r., a,(s)]. By the definition of z,-, z ^ G,(s-,). 



hence z < Q,(fl<(^),^-.) by (7), implies fl{(z) > ^ integrand 

in (12) is < 0 as desired. ° 

Figure 3 shows the utility function of player 4, uaM, in a PSP auction 
with / = 5 players, with s_4 fixed, and a valuation ^4(9) = IO9- The plateaus 
correspond to the points where 94 > QaIpa,^) = -51{jg>i>j»4}°j(*)] ' 
and 04(5) can no longer be increased at that bid price - see (2). At bid prices 
P4 > PS, the utility decreases when 04 > Q - 95, because after that point, 
each additional unit of resource is taken away from player 5, and thus costs 
PS, which is more than ff^ its value to player i. Thus, each additional unit 
starts bringing negative utiUty. This is what discourages users from bidding 
above their valuation. Proposition 1 is iUustrated by the fact that for any 
given quantity 94, the utility U4 is maximized on the plane p4 = ^ = 10. 

Remark: When the players have linear valuations and no budget con- 
straint (6f = 00). PSP becomes identical to a second-price auction for a 
non-divisible object. Then the existence of a Nash equilibrium follows di- 
rectly from incentive compatibility. 

Note that in PSP, the incentive compatibility (optimality of truth-telling) 
is in the price dimension, for a given quantity. With the message space we 
Have designed, there is no single "true" quantity to declare, the optimal 
quantity depends on opponent bid prices. Were the message process such 
that players declared a price and a budget (rather than desired quantity), 
it may have been possible to design an allocation rule A such that they are 
inclined to reveal their true budget, thus obtaining incentive compatibility in 
both dimensions, and hence equilibrium. But such a rule A would likely not 
have a simple closed form Uk? (2) and (3). In essence, the computational load 
of translating budgets into shares would be centralized at the auctioneer, 
thus making the system less scalable to large numbers of users. On the 
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Figure 3: Utility U4(s4) for si = (100,1), S2 = (10,2), -sa = (20,4), ss = 
(20, 7), 56 = (30, 12) 

other hand, decentralization has a cost too, which is the signaling overhead 
resulting from players possibly adjusting bids based on opponent bids in the 
iterated game. Our design is based on the premise that the latter approach 
is the more scalable of the two (indeed that was the reason for choosing a 
small message space). 

The next property is that the truthful best reply is continuous in op- 
ponent profiles (this can be seen in Figure 2: as the "staircase" is varied 
smoothly, the point of intersection with ^- moves smoothly, provided ^- is 
not flat - which is given by the last time item in Assumption 1). To prove 
that, we will need the following: 

Lemma 1 V5,5' € 5,Vy,2 > 0,V* > 0, t/ ||s_f - s!.,|| < 6 then 

Qi{y + 6.s.i) + sVf > Qiiy,s'_i) > Qi{y-S,s.i) - SVI, (13) 

and 

Pi{2 + 6 n/7. s-i ) + 6> P{{z, s'_i) >Pi{2-WI, s.i) -6. (14) 

Proof: First, ||s-, - >.'_,|| < S implies X)* kt-?t| < *v^.and pk+S >p't> Pk-S- 
Thus, E*9tl{p»+«>jl + > Et9*lK>y> ^ T,k<lkUp.-s>y) -SVl- Then, 
using (1) and the idfiilily {a + b)+ < (a)+ +(6)+, the first result follows. 
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For any y < PfC^,*!.), by (7), we have z > Qiiy,s'.i) > Qiiv - - ^Vl, 
which by (8), implies y-6 < Pi{z -^-.Sy/l^s.i). Letting y / Pi{i,^.i\ we get 

For any 1/ > Pi(z,^.i). by (8), we have 2 < Q.Cy.J?'..-) < g.(y + «,a-.) + «V/, 
which by (7) implies 3/ + 5 > - Letting y \ PiC^. "e get 

Pi{.z,^.i)>Pi^z-f>^i)-^- ° 

Lemma 2 (Continuity of best reply) Under Assumption 1, V» € I, iAe €-te«< 
reply t, ffiven tn Proposition 1 is continuous in S-i on any subset Vi{P, P) = 
€ Si : Vz >0,P> Pi{z, s.i)>P},withoo>P>P>0- 

Proof: Let z,- = sup G,(s_.). We will show z* is continuous, and the continuity of 
Vi = [z.— f/^i(0)]+ and u;,- = ?<(vi) follow immediately (recall that by Assumption 1, 

6^ is continuous). u l wr n 

Suppose there is a discontinuity at some s_,-. Then, 3ci > 0, such that > 0, 
3s' I € V;(£,P) with \\s.i - s'_,|| < * and ||z, - > ei, where z'f = supG^sl,). 

"suppose Zi+ti<z'i = sup G.Csi.) (the case z< + fi < Zi is handled identicaUy, 
with s-i and s'_,- interchanged. ). Consider the definition of d; since fl{ is decreas- 
ing and Qi{.,sZi) is non-decreasing and Pi(..s-.) > 0, any point to the left of is 
in the set Giis^i), therefore 

r. + fi€G.(s'.<)- (15) 
Thus, Zi + €1 < Qde^izi + = [q - E* 9kMpt>«:(.-.+<.)}] Therefore, 

Zi + £1 < <?i(<';(M + f 1) + •«-.) + «v7 , 

using Lemma 1. 

Also, by (7) zij- fi < g<(0;(z. + fi),*!..) => «<(x.- + fi) > Pi'i Now 
since 5* ,• € V;(Z, P), this last expression is > P > 0, hence ^(r* + <i) > 0. Then 
using Assumption 1, ^(z,- + «2) > «{(z.- + fi) + 7i(fi - «2) > ^(a- + 6, for 
^ < = ^ A ei7.-, and 0 < f2 < (fi - SiVl) A (fi - ^i/7.)- Therefore, smce 
Q,(.,s_i) is non-decreasing, 

Zi + (7 < Qi(6i{zi + f a), s-i) + SVI - f 1 + €2 

< Qi{e'i{zi+(2),s-i). (16) 

Now (15) also implies that 

bi > / Pi(ri,s'.i)dT, 
Jo 

> Pi{v,s^i)d7,+ r " [P.(i7,s'_.) - Pi(';-^-.)] dT, + (ci - f3)P, 

Jo Jo 
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and this holds Vfa < ^i- Now, using Lemma 1 



L^t = and £3 such that 0 < £3 < ei - (0 +'P)hy/l/P- Then 

6. > Pi{v,s-i)dv, i^"^) 

Jo 



U Jo 

tot * < *2. / X / \ » / i \ ^ 

j^i' Now choosing 6 < «i A«2, (16) and (17) imply that G.(5-.) 3 (z.-l-C3)A(ri+€2) > 

1= 2i = sup G,(«_i), a contradiction. 



We introduce one additional player, player 0, whose valuation is 60(2) - 
poz, and whose bid can therefore be fixed at sq = (go.Po) = (<?,Po). Player 
0 can be viewed as the auctioneer, and po > 0 as a "reserve price" at which 
h the seUer is willing to "buy" all of the resource from himself. Prom (1), the 

Iji presence of the bid so = iQ,Po) implies Vi € XMy,S-i) = 0,V9 < po- In 

U particular, setting y = 0, the condition of Proposition 1 holds. Thus we can 

ili restrict our attention to truthful strategies only, and stiU haye feasible best 

CJ repUes. This forms a -truthful" game embedded within the larger auction 

1=^ game, where the strategy space is T C 5, the feasible sets are n Si{s.i), 

and the best repUes are R^is) = Tif\ S\{s). A fixed point of ii' in T is a 
fixed point of 5< in S. Thus an equilibrium of the embedded game is an 
equilibrium of the whole game. 

Proposition 2 (Nash equilibrium) In the auction game with the PSP nde 
given by (2) and (3) and a reserve price po > 0, and players described by (j) 
and (5), if Assumption 1 holds, then for any e > 0, there exists a truthful 
e-Nash equilibrium s' G T. 

Proof- Vs € T, Vi 6 I. Vr > 0, we have z > 0 = <3.(po/2, 5-.), which by (8) 
implies'p.(z, s.i) > po/2 = £• Let P = maxtgiu^o] fii(O). Then, the conditions 
of Lemma 2 are satisfied and t = {v,w) is continuous in s on T. By Assump- 
tion 1. 0'i is continuous therefore v{q,p) = v{q,e'{q)) (as ilefined in Proposition 1), 
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can be viewed as a continuous mapping of [0,QY onto itself. By Brouwer's fixed- 
point theorem (see for example [10]), any continuous mapping of a convex compact 
set into itself has at least one fixed point, i.e. 3?* = v(q') € [0,QV. Now with 
s* = {q',0'{q*)), we have s' = l(s*) € T. ° 



3.3 Efficiency 

The objective in designing the auction is that, at equilbrium, resources al- 
ways go to those who value them most. Indeed, the PSP mechanism does 
have that property. This can be loosely argued as follows: for each player, 
the marginal valuation is never greater than the bid price of any opponent 
who is getting a non-zero aUocation. Thus, whenever there is a player j 
whose marginal valuation is less than player t's and j is getting a non- 
zero aUocation, i can take some away from j, paying a price less than t's 
marginal valuation, i.e. increasing u„ but also increasing the total value, 
% since i's marginal value is greater. Thus at equilibrium, i.e. when no one 

can unilaterally increase their utility, the total value is maximized. Formally, 
consider a 6 argmax^ E. The Karush-Kuhn-Tucker [17] optimality 

conditions are that there easts a Lagrange multiplier A such that ^i(o<) - A, 
if a. > 0, and flJ(O) < A, if a. = 0. 

Assumption 2 For any i £ I, 6,*= oo, and tf{ satisfied 

whenever z > > 0. 

Given any e > 0, for any e-Nash-equUbrium 5" € T, let a* = a{s*), and 
let or = minv€Tu{o},Qi>o a*> the smallest non-zero aUocation. The foUowing 
is the "€ version" of the Karush-Kuhn-Tucker conditions. 

Lemma 3 Suppose Assumptions 1 and 2 hold. If for some j, aj > y/ejK, 
to VielU{0}, 

An immediate corollary is that if a* > s/IJk then 

A* - 2v^ < < A* + 2^/i^ 

®If 8- is differeniiable, the condition is 0 > 0" > -k . 
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if < > otm/ 

if a* = 0, for some A* > 0. 

Proof: Suppose S|(a;) > flj(a;) + 2v^. Since fl;.(a;) > fl^Cg)) > p). we have 

Since a) > 0, if player i bids at a price above p), he can take all of player i's 
allocation, without losing anything of his own, i.e. a\ +a) < <?.(pj,5l,.). By (7), 
this implies 

p;> W+fli^-sli^- 
Let qi = (aj + yJT]^) and 5,- = tf-C^O)- Then 



> [fl5(an-'e\/^"p;]\/^ 

= e 

which contradicts the fact that s* is an e-Nash equilibrium. D 

Proposition 3 (Efficiency) Suppose Assumptions 1 and 2 hold. If a* > 
y/eJUj then 

wher^ >1 = {a € [0,^]^+^ : ti^i < Q}- 

Proof: (of Proposition 3) Let 1+ = : a* > aj) and I' = {k : at < aj}. For 
f € I+, we have tfjfa.-) < A* -f 2^?^. For t € I", we have a? > a, > 0, therefore 
by the lemma, fl<(a,-) > A' - 2v^. Therefore, 

^ 5:fl;(a?)(a,-an-i:^;(a-)(<-a.) 

< (A•4-2^/S^A-(A*-2^/?^^)A, 

where A = J2t^(ai - a') = Ez-K* " ^^O- Since A < Q the result follows, with 
the bound 4Qy/ol, ° 
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Remark a: The condition 6, = oo is sufficient, but not necessary to 
achieve efficient outcomes. In fact with any budget profile, efficiency can 
be achieved if the users cooperate. For example, if they all choose a bid 
quantity close to what they can actually obtain (which they do if they use 
the strategv' given by Proposition 1), then the price paid would be po per 
unit for all the allocations, and if po or the shares are not too large, 
then budget constraints are irrelevant and a* is efficient. More generally, 
efficiency is attained if the budgets are not too far out of line with the 
valuations, i.e. there are no players with very high demand and very low 
budget. 

Remark b: ( Welfare and Efficiency) A more common measure of effi- 
ciency is the social welfare, which is the sum of all the players' utility 
including the seller i = 0. The natural definition of the seller's utility is the 
value of the leftover capacity ao = <? - Et>to Pl^s the revenue, i.e. 

uo = M<»o) + 53 c,- 

Then, ui =: ZiM^i - ci) + «o = Zi^o »i + »o{ao) = Et ^i- Thus, Et 
is equivalent to the efficiency measure used above, which is Et^«" Another 
measure is the seller's revenue. Even though PSP is not, in general, revenue- 
maximizing, it tends to the revenue majdmizing allocations and prices as 
demand increases [18]. 

Remark c: Proposition 3 provides a key to understanding the basic 
trade-off between engineering and economic efficiency. The smaller e, the 
closer we get to the value-optimal allocations. But in a dynamic game, 
where players iteratively adjust their bids to the opponent profile, a player 
will bid as long as he can gain at least e utility (since that is the cost of 
the bid), thus a smaller e makes the iteration take longer to converge, i.e. 
entaUs more signaling. 

3.4 Convergence 

An issue of obvious concern is whether the game converges under dynamic 
play: it turns out that it does, when users behave rationally (see Proposition 
4 in Chapter 2 of [29] ). Moreover, irrational or malicious behavior - like 
intentionally trying to prevent convergence by making unnecessary bids - 
can always be controlled by setting the bid fee e high enough to make such 
behavior prohibitively costly for the culprit. 
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Figure 4: Parabolic valuation with k = 0.5 and q = 70 

Another issue is how the convergence time scales with the number of 
bidders. We now consider this experimentally using the software descnbed 
in Appendix B. 

In aJl our simulations we let Q = 100. For eJuJi user, the valuation is 
strictly increasing and concave up to a maximum corresponding to a physical 
line capacity, and flat beyond that. Since, as shown by Proposition 3, only 
the second derivative of the valuation is needed to measure the effiaency 
of the PSP auction, a second order (parabolic) model is deemed sufficient. 
Thus we use valuations of the form: 

r 

0i{z)= -Ki{zAqif/2-\-Kigi{2Aqi), 

where g,- is the line rate, and k, > 0 (see Figure 4). 

We generate our user population with independent random variables 
{^(0)}x (corresponding to the maximum unit price the user would pay) 
uniformly distributed on [10,20), and «. = e<(0)/5„ and g. uniformly dis- 
tributed on [50,100]. All players have a budget fc, = 100. The bid fee is 
fixed at c = 5. Each user has a bidding agent which can submit at most one 
bid per second (see Algorithm 1 in Appendix B). 

With this set-up, the results are shown in Figures 5-6. Simulations were 
run for 11 population sizes ranging from 2 to 96 players. Each point is 
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Figure 5: Mean (+/- std. dev.) number of bids - soDd line. The dashed 
lineis / + /VIO. 

simidated 10 times with new random valuations for all players. The overall 
mean is 11.9 bids per player. Prom Figure 5, the number of bids seems to 
grow as the square of the number of players. 

The actual time to converge, shown in Figure 6, grows more slowly, since 
the computation of bids is done in parallel by all the players. In fact, for 
small numbers of players, the time decreases. This can best be explained as 
follows. Suppose there are only two players, with similar valuations. They 
will both start by asking for their maximum quantity, at their marginal 
valuation (which at their maximum quantity is near zero). Then as each 
sees the other's bid, each wiil reduce the quantity and increase the price a 
little bit. And they go on taking turns, gradually raising the market price 
until they reach an equilibrium. However if there are 10 players, in between 
two bids by the same player, the 9 others will already have bid up the 
price, so he will jump to higher price than if there was only one opponent. 
Thus the equilibrium market price will be reached more quickly. For laxge 
populations, this effect becomes small compared to the sheer volume of bids, 
and the convergence time starts to grow. 

The trade-off between signaling and economic efficiency discussed in light 
of Proposition 3 is illustrated by Figures 7-8. Increasing the bid fee speeds 
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Figure 6: Mean (+/- std. dev.) convergence time in seconds (for a 1 second 
bid interval). 

up convergence, at a cost of lost efficiency. A resource manager should select 
a bid fee which optimally balances the two for the particular context. 

Figure 8 also illustrates the vaUdity of the lower bound given by Propo- 
sition 3. 



4 Conclusion 

Auctions are one of oldest surviving classes of economic insti- 
tutions [...] As impressive as the historical longevity is the re- 
markable range of situations in which they are currently used. 
[22] 

We proposed the progressive second price auction, a new auction which 
creneralizes key properties of traditional single non-divisible object auctions 
xo the case where an arbitrarily divisible resource is to be shared. We have 
chown that our auction rule, assuming an elastic-demand model of user pref- 
erences, constitutes a stable and efficient allocation and pricing mechanism 
in a network context. Even though we are motivated by problems of band- 
■vidth and buffer space reservation in a communication network, the auction 
A as formulated in a manner which is generic enough for use in a wide range 
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Figure 8: Ei^iWi) " solid line, and maxa E.^.Ca.) - 4(6k)-'/2 _ hashed 
line, vs e. 
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of situations. In the sequel to this work, we show that the key results - 
namely incentive compatibility, equilibrium, and efficiency - generalize to a 
setting where multiple networked resources are auctioned, with users bid- 
ding on arbitrary but fixed routes and topologies [29, 31], In related work, 
we consider the case of stochastically arriving players bidding for advance 
reservations (i.e. resources for a given period of time) [29, 30]. 

An interesting direction of future work is learning strategies, and evolu- 
tionary behavior which can emerge from repeated inter-action between the 
same players. 
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A Information-theoretic basis for the valuation 

In general, valuations are simply assumed to be given as external factors. 
Indeed, the fundamental assumption in any market theory is that buyers 
know what the goods are worth to them. The "elastic demand" or "'di- 
minishing returns" nature of Assumption 1 is fully justified from a purely 
economic standpoint for virtually all resources in everyday life. 

In the case of variable bandwidth, we can go even further by better quan- 
tifying what the goods are. For a user sending video, say, how much \"alue is 
lost when the chaimel capacity goes from 1.5 to 1.2 Mbps? Ultimately, the 
value lies not in the amount of raw bandwidth but in the information that is 
successfully sent. Our goal in this section is to give a brief description of how 
Information Theory can be used for a bottom-up construction of bandwidth 
IZ^ valuations - based on the fimdamental thing the user cares about which is 

communication of information - and that such valuations will generally be 
of the type in Assumption 1. 
'il Any information source has a function !?(.), such that when compressed 

^1 to a rate iZ, the signal has a distortion of at least D(R) [1]. The distor- 

tion is the least possible expected "distance" between the original and com- 
! pressed signals, where the minimization is over all possible coding/decoding 

schemes. In this context, we make the distance measure the monetaxj* cost 
of the error. This cost can be chosen, for example, to be proportional to 
i|l some common measures like the mean squared error, the Hamming distance 

1^1^ (probability of error), the maximum error, etc., or heuristic measures based 

III on experiments with human perception. Given that modern source-coding 

techniques can, given a distortion measure, achieve distortions close to the 
theoretical lower bound[5], it is not unreasonable to use the rate-disrortion 
curve as an indication of the value of the bandwidth share. 

Let A(0 be the distortion-rate function of {Xi{t)}, a stochastic process 
modeling the source of information associated with user t. Xi is encoded as 
Yi which has a rate of R bits per second. 

Shannon's channel coding theorem[32] states that Yi can be received 
without errors if and only if the channel has a capacity C > R. Jn our 
auction context, user i has capacity (bandwidth allocation) C = a,*, and 
thus has to suffer a distortion of at least Di{ai). The value of the bandwidth 
is then 

9i{ai) = Fi^Di{ai), (18) 
where 0i is the value of the full information. 
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The relevant properties of the distortion-rate functions are: 

• when the rate is greater than the entropy of the source, the distortion 
is zero, and 

• for many common source models and cost functions, the distortion- 
rate function is convex, and has a continuous derivative. 

It is easy to see that, with these properties, (18) satisfies Assumption 1. 

Example 1: Let {X} be a Bernoulli source, taking two values with 
probabilities p and 1 - p. Without loss of generality, let p € [0, 1/2]. In this 
case, since the source is ia.d, one can define the distortion on a per symbol 
basis. Using a Hamming cost function 

diX,Y) = lix^Yh 

i.e. assuming it costs one unit of money every time one bit is wrong, we have 
III the distortion D = Ed{X, Y) = P{X Y ). the rate-distortion function is 

jff where H{x) = -xlog(a:)-(l-i)log(l-J and the distortion-rate function 

is the inverse function. It can be easily seen that D( A) is strictly convex and 
= decreasing for 0 < < H{p), and D{R) = 0 for Ji > Hip). The continuity 

of !>' on 0 < /i < Hip) aad R > Hip) is obvious. At the critical point 
(R = Hip), D - 0), we have 



ill 
1=1. 

Hi 



lim D\R) = Urn IfR'iD) 



h = Um l/logiDll-D) 

D\0 

= 0 

= lim D'iR). 
R\H(P) 

Thus continuity of D' holds throughout, and Assumption 1 is valid for the 
valuation of the form (18) for this source - see Figure 9. 

Example 2: Let {Jf} be a Gaussian source with Markovian time- 
dependency, i.e a covariance matrix # = j ' ** ^ I^' ^ Suppose we 
use the squared error cost, i.e. it costs one unit of money for one unit of en- 
ergy in the error signal. Then, we have for low distortions D <(l -7-)/(l-f-r), 
R(/?)=^logl^,or 

D(R) = (l-r-'<T^2-^^, 
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Figure 9: Distortion-rate based Aquation for a Bernoulli p = 1/2 source 

and Assumption 1 clearly holds for (18). In the i.i.d. case (r = 0), the 
formula holds for all i2. 

As the source models get more complex, it rapidly becomes impossible 
to give closed-form expressions for either R{D) or D{R). Often parametric 
forms are a\'ailable, and the functions can be evaluated numerically. Fortu- 
nately, the convexity property extends to a wide class of models, including 
for example auto-regressive sources, even when the generating sequence is 
non-Gaussian (see [1] for a full treatment of jR(jD), including the above 
cases). 

It can happen, e.g. for some video source models, that the R-D curve, 
which gives the best (R,D) pairs achievable by any coder/decoder, is not 
convex. But, for tractability, practical codecs are usually optimized on a 
convex hull of the space of possible (R,D) pairs[26, 27]. Thus, even when 
the theoretical D(R) curve is not convex, the actual distortion achieved in 
real-life systems almost always varies in a convex manner with the available 
bandwidth. 
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B Simulation software and bidding algorithm 

A prototype sofb.axe agent ba.ed implementatioB of the auction g^e, 
faUed TI^X, has been developed and extensively used since December 1995 
MTcb of the iitnition behind the mechanism design and the ^na^y- - tks 
worlcame from experiments done on this inter-active distnbuted auction 
eame on the World Wide Web, using the Java programming language. The 
l^e 1 be played in real-time by any number of players from anywhere 

°" E^c^lrSm the dynamic auction game using the following: . 
Algorithm 1 1 Let = 0, and J_. = 0. StaH an independent 
thread which receives updates of s-i. 

2 Compute the truthful e-best-reply of Proposition 1, U € Ti n 

3 // m(t,-; 5-0 > 5-.) + then send the bid 5,- = 

4 Sleep for 1 second. 
B Go to 2. 

No assumption is made on the order of the turns. Pl^y^" ^.^^ 
at different times, and depending on the execution -^^^ 
program, the sleep time of 1 second is more or less ^^^''''^^l''l.?^;ZT^ 
w tf communication delays which make the times -^^"fjf 
the server and updates at the clients essentiaJly random times, make the 
distributed eame completely asynchronous. , „ ,e v 

Crithi 1 can be described as selfish and short-sighted. Selfish because 
it will submit a new bid if and only if it can improve it's own utiLty (by more 
hL the fee for the bid). Thus, the game can only converge^ to an e-Nash 
quilibrium. And short-sighted because it does not take the extensive fo^m 
0? the game into account, i.e. does not use strategies which may result m a 
temporary loss but a better utility in the long run. 
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Chapter 4 

Spot and Derivative Markets in Admission 
Control 

Xei game now risk, G. [87] 

In Chapters 2 and 3, we proposed a pure market approach for bandwidth pricing, 
where allocated capacities may vary during the lifetime of a flow, as players compete 
for resources through an auction game. 

In this chapter, we propose a mechanism for circuit switched calls, wherein calls 
are admitted or rejected at (or soon after) their arrival time, and if admitted, get 
a fixed allocation of capacity, and have the option of securing the resource at a 
guaranteed maximum price for a guaranteed minimum duration. Thus the charge 
has two components: 

• a market-based usage charge, where the user continuously pays the ''instan- 
taneous" market price (determined by second price auctions simong recent 
arrivals); if the market price exceeds a user's bid price, that user is dropped 
unless 

• upon arrival, the user pays a reservation tee i buys an option contract), which 
gives him ilir right to buy the capacity M any time in the future up to a 
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specified duration at his bid price. The user pays the market price as long as 
, it is below his bid price. If at some point during the call, the market price 
exceeds the bid price, then the user automatically exercises the option, i.e., 
remains connected while paying no more than the bid price. 

In other words, we i-troduce a "derivative" instrument to reduce the uncertainty 
inherent in the "spot" znaiket mechanism. Naturally, this contract (or reservation) 
must itself be sold for a "fair" price. In the context of financial markets, the fair price 
is calculated with the Black-Scholes approach [8, 65], which is based on the idea that 
the option must be priced such that a perfectly hedged (i.e., riskless) combination 
of the derivative and the underiying equity will provide (locaUy in time) the same 
expected return as a risk free security [36] (otherwise the derivative would present 
an arbitrage opportuni:y. i.e., unfair advantage, which would be exploited until its 
price rises). 

In our context, the contract differs in that, rather than the right to buy once at 
a given strike price, it gives the right to buy repeatedly over a given duration, i.e., 
it is a series of "call options". Here the "fairness" we seek is that the reservation 
be priced in a way tha: reflects the probability that the system will become busier 
during the lifetime of :he reservation, in order to avoid individually rational but 
socially sub-optimal behaviour. Specifically, we seek to avoid customers connecting 
at low periods and making a reservation limiting their usage price to an excessively 
low price for a very long time, to avoid rejoining when the prices are higher^ 

A further difference from usual options is that, rather than the standard geo- 
metric Brownian motion model of e.g., a stock price, we have an underiying spot 
market process that is derived directly from our queueing system, via a heavy-traffic 



• A simplified form of this arbitrage is commonly observed with flat-rate pric<<d dial-up Internet 
access, wli^r- .some users rer.-.ain logged on for very long periods of time eveii if iliey are not using 
the network, in order to av::d the chance of g.»tting busy signals when they nivd to he on. 
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Figure 4-1: Queueing Model 
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approximation which leads to a difFusion process. 

Prom the point of view of the user, this pricing mechanism is simply an initial 
reservation fee plus a per-minute (for example) usage charge. The novelty in the 
networking context is that both are market prices. 

In Section 4.1., we derive a heavy-traffic difFusion approximation model for the 
queueing system. Using that, in Section 4.2., we derive the corresponding model for 
the spot market price. Then in Section 4.3., we introduce our formulation of the 
reservation as a derivative financial instrument. Finally, in Section 4.4. we present 
some simulation results using a real trace of traffic at a dial-up Internet access 
modem pool. For the sake of readability, detailed calculations are relegated to 
Sections 4.5. and 4.6.. Although not strictly necessary, a layman's grasp of financial 
markets is helpful in reading this chapter. 



4.1. Queueing Model 
4.1.1 Preliminaries 

Customers arrive in a Poisson stream of rate A, with i.i.cl. bid prices distributed 
according to a distribution F (density /). Call durations are exponentially dis- 

/r3 
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STAGE I 



STAGE II 




call camp tttd 



Figure 4-2: Pricin? Mechanism 

tributed with mean l/r. The queueing system is shown in Figure 4-1. It consists of 
two stages, with buffers of size B and C resp-ectively. 

The first stage consists of a second price auction, where the winners enter the 
second stage, and the losers leave the syster=. Specifically, the first stage has an 
exponentially distributed service time r \vi:i mean At a service completion 

instant, let m be the number of customers Lz the first stage and n the number in 
the second stage, at that time. The m first s-.age customers are ranked according to 
their bid prices. The {C-n) highest bids are accepted into the second stage, and the 
remaining m - { C - n ) are dropped. The bid 7 rice of the highest dropped bid defines 
the new spot market price, which is vahd ui:vj the next batch. If no customers are 
dropped, i.e., m < C - n, then the spot market price is zero. Figure 4-2 shows the 
functioning of th*' mechanism. 

The second st^gr is a C server queue 'r-:h no waiting room, where each cus- 
tomer has an exijonential service time (call duration) of mean l/r. The arrivals 
are according io <> hatch Poisspn process, rate /i, and batch sizes distril)uted 



according to i3„,}^^. Let /> = A//i. For 0 < m < B, 



0^ = P{m arrivals in t} 



- (1 + 



and 



= E 



OO 




In Section 4.1.2, the steady-state distribution of the occupancy of the second 



the reservations, we need a (probabilistic) model of its transient behaviour in the 
future, given :he current price. This is done in Section 4.1.3. 

4.1.2 Product-form solution 

Let the state of the second queue (admitted calls) he X = {Xi,.,.,Xk), where 
Xk = {Xk.i- • . . ,XkMk)^ is the bid price of the i-th player in the A:-th batch, 
Mk is number of calls remaining from the A:-th oldest batch, and K is the number 
of batches present. Let N = ELi the total number of active calls. The letters 
x.TUk, and n -»vill denote generic values of and iV, respectively. 

X{t) is a :ontinuous time Markov process. The transitions are of two types. On 
one hand we have departures of individual customers: 



queue can be shown to be of product form. However, for the purpose of pricing 



.r = (a:i,.. . ,xjt,...,XK) ^ x' = (a;i, . . . , et(xA:), r/x ). 



(4.1) 
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occuring with transition probability 

where e,(x,) = . . . , x,,.a, . . . , x,,^ J. On the other hand, we have batch 
arrivals: 

X = (xi,...,XA-) x' = (Xi,...,XA',XA-+i), (4.2) 

occuring with probability intensity 



111 
W1 



7(X, X') = Mi^mK+i n /(^A'+l,t) 

if 0 < TTiK+i < C - n, and 



B m! 

171=171X41 ~ 



O ifm/f+i = C-n. 

Proposition 11 Tht tquilihrium probability of being in state x = (xi, . . .,xk) is 

.,.)_,„)(_£_)"ft^|/(.,,, (4.3) 

where the normalization constant is given by 



1/^(0) = L 

{i:0<Tj<C} 
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Proof: To prove the theorem, we first analyze and then conjecture the transition rates 
7* of the reversed process, X{-i ). and then veriiy that the following balance conditions: 
Vx,a;', 

ir(x)'rix,x') = ir{x')','ix',x), (4.4) 

and Vx, 

E^(^'^o = E7*(^'^'), (4.5) 

hold. Indeed, if (4.4) and (4.5) are satisfied, then by Theorem 1,13 of [46], tt is the 
eqnilibrinm probability of the Markov process X{t). 

Conjecture: X{-t) = x has the following properties: 

• new batches are formed by customers arriving according to a Poisson process of rate 

• arrivals into existing batch k are according to a Poisson process of rate Xk{x). 
Arriving customers have a bid price i.i-d. with distribution F; 

• upon arrival into a batch, if the system is not full {n < C), the customer is placed 
with equal probability in any position within the batch (from 1 to mjt + 1)- If the 
system is full, the new customer departs immediately; 

• batch A; has an exponentially distributed service time, with mean l//ifc(x). 
The rates for the reverse process are the following. First, 

Ao = /i(l - /3o). 

Second, if n < C or k < K, 
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and 

J fikix)p if 1 < mjt < 5 
[ 0 if mjfe = 5 

Third, when n = C, and A; = A', i.e., for the last batch when the system is full, 

m=m/f 

and 

AA'(a:) = rmA- - /iicCa:). (4-6) 

Note that in this last case all the arrivals immediately depart. 

We begin by verifying (4.4). For the transitions of type (4.1). i.e., corresponding 
to departures in the forward process, consider a departure from the A-th batch. When 
mjt > 1. (4.3) yields 

p Tfik ""If/ 

7r(xi, , . . , Xit, . . . , XK)r = 7r(xi, . . . , et(xA:), . . . , ^K)^^^ /(^m)^- 

Since mjt - 1 < 5 - 1, we have /J^a,-! = V(l + /))""*, and therefore /ifc(x') = r ttia: - 
- p). On the right hand side the system is not full (n' = n - 1 < C - 1). hence 
Ait(xO = fik{x')p = Y^r{mk - 1). Thus we have 

7r(x)r=7r(xO^/(xM)- 

Now, since arrivals in the reverse process take any position in their batch with equal proba- 
bility, A^(x')/mjt is precisely the arrival rate into position i in batch A:, i.e., Xkix')/mk:(xk,i) 
7"(x'.r ). as desired. If m)t = 1. (4.3) yields 

r(Xi,...,(xjt,i),.-.,XA)/- = 7r(xi,...,xjt-i,xjt+i,.....'CK-)Y^^/(xA-,i)r 

= 7r(xi J . . . , xjb-i , Xk+j , . . , , XA* )Ao/(^ita ), 



# ft 
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as desired. 

For the transitions of type (4.2), if 1 < mjc+i < C - Yik^i 



as desired. If m^+i = C — Sj^i^ 



5 t TTlK+l 



l<t<mA'+i 



ml 



H' \ H y m=mK+i 

= 7r(a;'>K+i(a:0, 
as desired. 

.We now verify (4.5). The left-hand side is the total rate at which the forwaid process 
X(t) leaves state x, which is /i{l-;3o) + nr. The right-hand side is the total rate of leaving 
state X in the reverse process. Consider first a state where the system is not full (n < C). 
The total rate is then (letting k range from 1 to A') 

Ao+E^it(x)-^M*(x) = /x(i-A))+(i+p) E 

^ mk<B yrik-B 



= Ml-/?o) + (l + P) E (1 + p^^-n {—) 
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as desired. Now when n = C, the rate is 



K-l 



Jk=l 



= fi(l - Po) + (n - mK)T + rmji- - /lA-(ic) + t^Kix), 

where the second term is derived as in the ti< C case above, and the third term comes 
from the definition (4.6). Then the right hand side is /x(l - Po) + nr, as desired. □ 



4.1.3 DifFusion approximation 

We develop a tractable approximation for the queue occupancy process Nt, by scal- 
ing the system following the well-known heavy traffic approach [37, 9, 97, 98, 18], 
applied here to a system with batch arrivals. 

Let a ^ ^, m ^ EM = El^o^Pm. and = IE(M2) = E^om^/^n.. Consider 
a sequence of scaled systems, indexed by / = 1, 2, . . ., with capacity = la+^Vl^, 
where 7 is arbitrary, and batch arrival rate fi^'^ = I ft. Let 



(n A nP - la 



(4.7) 



the translated and scaled version of the queue occupancy of the /-th system. The 
drift and diffusion coefficient respectively are 

■7(1) 



a(')(r) i limE 



-rz if z < 7 

-r(7 -I- Vice) if 2 > 7. 



(4.8) 



ICO 
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and 



(1 + vVni + if2<T^ 



(4.9) 



The basic idea is that a. / oo, (where =i> denotes weal; convergence, 

i.e., the probability distributions converge), where is the diifusion process which 
solves the stochastic differential equation 



dZt= a{Zt)dt + a{Zt)dWu 



(4.10) 



where Wt is a Brownian motion. 

Note that, for 7 < 00, the offered load aO/CO = (1 + t/VT^)"^ / 1> -'^<^ 
makes it a "heavy traffic" approximation. 

The coefficients a(.) and a?(.) are obtained by letting / - 00 in (4.8) and (4.9) 
respectively. In the original approach of [37], Zj'^ =^ Z, holds if a(.) and are 
continuous, which is clearly not the case here, since both have jumps at 2 = 7. 
However, based on a theorem of Borovkov [9], Whitt [98] proposes a conditioning 
heuristic to derive approximate steady-state blocking probabilities for the G/GI/s/O 
(i.e., s servers, no waiting room) queue from the diffusion approximation for the 
corr^ponding G/GI/00 system. Our approax:h here will be to apply the heuristic 
to the diffusion process itself, conditioning on Zt < 7- 

=[98] p. 694 states that, for e.xponential service times, the heuristic is also applicable to the 

diffusion process itself. 
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4.2. Diffusion Models of the Market Prices 
4.2.1 Spot Price 

Suppose that at time t, the queue occupancy is Nt = n, and a batch of size m airives. 
The admission decision is made, and a new spot price results. In this section, we 
want to derive a model which will tell us in some sense the future evolution of this 
price. 

Consider the mechanism by which the price arises. Of the m new customers, 
those with the C - n highest bid prices will be admitted, and the spot price wiU 
be the (C - n + l)-th highest bid price. Recall that the bid prices are i.i.d., with 
distribution F, which we assume to be smooth. The probability that the price is x 
is the probability that in m draws, one will equal x, and of the remaining m - 1, 
C-n will be greater than x, and (m - 1) - (C - n) will be less than or equal to x, 
which is 



The distribution is 



, ^.^ „ [F(x)]-^-^"-^ [1 - F{x)f-- fix) 
- n)!(m - 1 - C + n)! 



-i: 



^(*) "7! TO-C+n-l/i ..\C-n 



(C - n)\[m - \ - C ->r n)\ 



where the last equality comes from substituting the previous expression, and making 
the change of variables u = F(y). du = f{y) dy. 

Let us consider a ^'first-orclei " iipproximation, the expected spot price given the 
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occupancy n and the size of the batch arrival m: 



■ Jo 

= f f ■g(u,n,m)dudx 
Jo Jf{x) 

= [ F-^(u)9{u,n,m)du, 
Jo 



where 



^(^-■■^■"^)=(C-n)!(m-l-C + n)!" ^ ^ . ' 

4.2.2 Diffusion model of the spot price 

For the purpose of pricing a reservation beginning at time t, we would like to char- 
acterize the rature evolution of the market price, in terms of what is known at or 
just before t. namely the occupancy Thus, it is natural to consider the process 

B 
m=0 

Remark: We prefer the above expression to one that uses the information in 
the batch tha: arrives at time «, since computing the option prices based on the new 
arrivals wouic add to the delay in the admission decision. By not waiting for the 
new information, we can use the time in between batches for computation of option 
prices. Of CG-jrse the spot price results froih the auction among the new bids, but 
that is a very simple computation. 

Now. we approximate the price by a sequence of functions of the centered and 

scaled procesf Zt'\ 
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Then, Ito's rule (see, e.g., [45]) along with (4.10) yields the stochastic differential 

equation for P: 



dz '2 



^^+^^(0^,. (4.12) 
dz 



Since 

B 



where is defined as g with C('> instead of C, it follows that 

— (^) = E ^r.f F-\u)j-/\u,yfaiz + a/,m)dzx, (4.13) 

171=0 ^ 

and 

^(.) = E 3„ /' ^-(u)|5/'(«.^/S7-- + ai, m) (4.14) 

m=0 ^ 

Now (4.12), along with (4.8), (4.9), (4.13) and (4.14), constitutes a diffusion 
model for the spot market price P„ as / ^ oo. From the results derived in Sec- 
tions 4.5, and 4.6., we can approximate (4.12) by dPt = 0 when z < 7, and 

^^V^(lp,-Kt')dw\. (4.15) 



- = ^. y is a constant related to the accuracy to which we want to evaluate 
g, and can typically can be taken to be 1 (see Section 4.6.). Vm, the constants 
A'i"''. aI"', which depend only on the bid price distribution F. are defined (and 
can computed) by (4.23) and (4.25) respectively. 

Remark: z = 7 corresponds to .V, = C, i.e., the system is fi.ll. Thus we have 
a n,„.l. l where the spot price remains constant when the system is below capacity, 
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and varies when the system is full. This corresponds to what one would intuitively 
expect from the auction mechanism (with the constant price 0 when the system is 
not full). Note that we do not attempt to model the transitions between the two 
regimes, so this model is meaningful only during periods when the system is almost 
always full. 

4.3. Computing Reservation Fees: the Derivative Market 

Taldng the current market price as initial condition, the solution of (4.15) provides 
a stochastic model of the future prices {P^U, (this solution is unique in distribution 
- see 145]). From that, we now determine the price of a reservation, arriving at time 
with a holding time r, and a bid price p. The value, or '^air price", at time t of 
an option to buy a security for a "strike price" p at a specific future date^ r > f is 
(see [45, 36]) 

Cr=E(PT-p)^ 

In our context, this concept must be extended in the following straightforward 
manner: we define the reser^^ation a. a hold opUon, a new kind of derivative instru- 
ment which is an option to buy repeatedly at every time instant from ttoi + T. 
Thus the reservation fee should be 

If = K, = 0, Cr is given explicitly by the Black-Scholes formula [36].. For the 



3This is called a European option, as opposed to an American option, which is the right to buy 

at any time between i and r. 

Note that we take the risk-free interest rate to be U. 
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more general form (4.15), which we re-write as 

dP. = {APr + Ks)dt + {DPr + K,)dWt, (4.17) 

for r > t, with known initial condition Pu the solution is (see [45], Section 5.6) 



where 



S.^exp[{A--DV2){r-t) + [DdW^]. 

Knowing the set of distributions V. ^ {P(P. < xlPO, Vx : r > t}, we can evalu- 
ate Ct, for T > i and the reservation fee <f> follows. 

4.4. Simulations 

In this section, we simulate the pricing mechanisms presented in the preceding 
sections, applied to dial-up Internet access. 

Our data set consists of all the connections that were maxie to the Columbia 
University modem pool between April 4th and May 10th 1998. At that time, the 
svstem, with a total of 316 lines, was very heavily loaded (except for the period 
r'ouehlv from 2AM to 7AM every day, essentially all lines are always busy). There 
was'a total 669,994 calls, from 9451 different users, with an average inter-axrival time 
of 5.59 seconds, and an average call duration of 1299.3 seconds (see Figure 4-3). 

The unsatisfied demand, i.e., the calls which encounter busy signals, axe not 
loe.ed in our data trace, since the blocking occurs in the public telephone network. 
Our data trace only includes admitted calls. Thus feeding the trace into a system of 
316 lines would result in no blocking, which would not be interesting since blocked 



108 



call duraioo — mean = 21 -SSmin 




Figure 4-3: Modem pool call .Utistics (solid) aBd equivalent - same mean - exp<. 
nential distributions (dashed) 

call, axe what gives rise to the market price. By scaling down the capacity of system 
in our simulation, we can recreate the congestion. The traffic wa. fed into a system 
„m>ing with 202 line., ot which 18 were allocated to the first stage, and 184 ^ 
the second stage. ^ call arrival times and bid durations are from the real traffic 

. ■ .1 inv r»»l-timesneed), while bid pnces are 

trace (however the simulation was run at lOx real time sp 

randomly generated from f , the uniform distribution on (0, 1). 
. Rather than explicitly evaluating the set of distributions functions V, resulting 
from (4.18), our technique consists of Monte-Carlo siumulation. SpecificaUy, at each 
time when a reservation has to be computed, beginning at the known current pnce 
P, we generate sample paths by the difference equation corresponding to (4.15), 
„hich results in a set of histograms (one for each vjue of r) corresponding to V,. 
Figure 4-4 shows a representative example. 

Since the arrival process is clearlv time-varying, the implemented reservation 

r \ anH r to evaluate the constants i4, /v3, 
mechanism makes real-time estimat cs c,r A. and r , to evai 

and A'.,. >ising the formulas in Section lii- 
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Figure 4-4: Histograms ot P., for P. = 0 and r = 0, 1, 2 minutes; the bins represent 
price levels [0, 0.1), [0:1, 0.2), .... (0.9, 1). 



; eg 




1 

|0.5 



t J . 



150i 

i 

I 100; 




2 
days 




Figure 4-5: Simulation trace 
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Figure 4-5 shows a snapshot of the simulation trace. The first plot shows the 
number of users arriving in each batch interval, where i = 1 minute. The second 
plot shows the spot price process resulting from the batch auctions. As expected, 
prices are zero when the system is lightly loaded during the night. The average price 
including days and nights is 0.2055. 

The third and fourth plots show the number of users in the second stage, in the 
reserved and unreserved states. In this simulation, all users accept the reservation 
offer, thus they only remain in the unreserved state for a brief period, from the time 
the offer is sent by the auctioneer (which is a server program), until the acceptance 
:| returns from the user (which is a client program on a different host). 

Ill In the fifth plot, "value" is the sum of the bid prices in the second stage (re- 

served+unreserved): this represents the social welfare, or the total value that the 
jji users are getting from the system. Without pridng, i.e., if all the users were sim- 

U ply admitted on a FCFS basis, the average value during pealc periods would be 

ii 184 X 0.5 = 92, since the average bid price is 0.5. Here the average value during the 

ji day is approximately 110, i.e., the pricing mechanism yields a 20% gain in efficiency. 

:! In other words, without pricing there are many times when a user who values access 

less is denying a user who values it more. The efficiency is shown more clearly in 
Figure 4-6. normalized so that the horizontal Hne corresponds to the FCFS system. 
Note that there is an efficiency gain of up to 10% even during off-peak hours, because 
some of the off-peak users arrived during peak hours. 

The sixth plot of Figure 4-5 shows the cumulative revenue from usage charges 
and reservation fees. Since the batch interval is one minute, and usage charges are 
assessed on a minutely ba^is, we take the price of 1 as the "full price" reference level, 
i.e., onr ni.il of revenue is when 1 line is charged a price of 1 for 1 minute. The 
unit is ( .lied ... MOU (minute-of-use). As can be seen on the plot , i he revenue for 



0 
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Figure 4-6: Efficiency: 1.0 = first-come first-served system 

one day is approximately 125,000 MOVs. The 184 Unes multiplied by 1440 minutes 
in a day yield about 264,960 potential minutes of use. Thus, on average, a modem 
Une generates 0.47 MOUs of revenue per minute, including usage and reservation 

charges. 

Figures 4-7 and 4-8 show how the reservation fee offsets any attempt to "arbi- 
trage". Durations range from 0 to 24 hours, and the reservation fees range from 0 
to 640 MOUs, with the highest ratio being 1 MOU of reservation fee per minute of 
reservation duration, as can be seen by the straight line upper-bounding the scatter 
plot in Figure 4-7. The highest ratio (most expensive reservation) would be for a 
user who gets into the system with a bid price near zero and requests a long reser- 
vation at a time when the arrival rate is high. That is illustrated by Figure 4-8. 
A user asking for a long duration reservation at a low bid price must pay a higher 
fee which compensates for the expected future rise in prices. The vertical variations 
axe due to the market price at the moment the reservation offer is made, where the 
higher end are reservations made when the market price is high. 
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Figure 4-7: The reservation fee is at most Ix duration. 
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.8: Reservations are proportionally more expensive for low bid prices. 
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4.5. Approximations related to g 

We first seek a convenient approximation of (4.11). Fix V > 0. 

4.5.1 Case mu(l -■u)>V^ . 

By the Central Limit Theorem, the binomial density tends to the normal density, 
i.e., for 0 < u < 1, we have 



ml 



k\{m - k)\ 



- u) 



k ^ 



1 f -[fc-(l-«)mf l 



27rmu(l - u) 



Thus, 



g{v.,n,m) = 



C-n 



(C-n)l{m-l-C + n)\ 

Lc^n__l__,,p(-fC-n-(l-^Hn 



Differentiation yields 



o r 1 C - n - m(l - u) 

^(ti,n,Tn)K(/(tt,n,m)|^^^^3-^^+ ^(i _ «)m 



and 



+ 



C-n- m(l - ti) 



^_(C-n) ' ii(l-u)m 
"(m-C + n) ~ u(l-ti)m}' 



Now, recalling that C^') = /a + -rVl^, we get 
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:exp < 



2u(l - u)m 



CO t.e exponctiaa sees to ^ faMc th. the othe. factor 
^w, thus |;Kv^. + .i.™),&(''.VS^ + °'"") 0. Th«e,o., by (4.13) 
and (4.14), ^fiW = - »• 

But when 2 = 7, 

,r/i IV-J-- - 

l-g{u,V^lz + al,m) "'[Vm"u; u(l - «)mj 



as / 00, 



where - indicates that it is an approximation valid for large m. 



4.5.2 Case mu(l - ti) < V2 

• i-u V, nf 7/ - 1 and u = 0, where the normal approx- 
Here we consider the neighborhoods of « - 1 and u , 

imation is no longer valid. Indeed 



and 

5(0,n,Tn) = Tnl{c-Tn+i}(")' 



»herel5(x) = lifxeS^'i=C°t''"»'^- 
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Thus, for « near 1, we write 

5^ r 1 ^1 



where 6 is the Dirac-6 function. , i,. u 

For u near 0, we get the sa^e approximation with 7 replaced by 7 - ^ , wh,ch 

becomes identical to the above as / 00. 
HereVz,^(z) = ^(-)-0- 



4 



.6. Approximating the Drift and Diffusion Coefficients 

When z ^ 7, by the results of 4.5.1 and 4.5.2, the right-ha.d side of both (4.13) 
a.d (4.14) 0, as / ^ CO. Therefore, by the finiteness of (4.8) and (4.9), the 
right-hand side of (4.12) 0, as / 00. 

Thus we need only be concerned with the regime z = 7. Let 



^ 1 - yi - 4VVm 

Uv,m = 9 ' 



which satisfies - u.,„)™ = V ca. be int«preted a. the s^aUest variance 

which the binomial distribution is snfficiently close to the nonnal dis,nbut,on. 

Typically V can be taken to be about 1. 
' Now we will approximate , and its partials in three regions: [0, uv..)- l"v.., 1 - 

ttv.m], and ( I - "v.m. !]• 

In the ms, „„<! last regions, a. shown i„ Section 4.5.2, the coeff,n..n,s tend 
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6 

3 ; 



to 0 Thns »e n«d only focus on the middle region, where the appoximations of 
Section 4.5.1 apply. Abo, if m < 4V^ -v.„ is not real, and in fact we axe always in 
the case of Section 4.5.2, where the coefiidents .end to zero. Thns we have non-zero 
terms only when m > 4y^. 

Writing am = -rC + ^) = -^1^^' P'"^^"'* 



as / oo, where 



,,(m) A / f-i(u) ====exp^ 2u I 



m , ^;^ + m /2 ^^/2^,„ (4.23) 



m V 



where the 



second line follows from a change of wiables w= 7(1- «)m/«, 



ti,;*") i 7(1^ UV,m)"l/tiV,m, 



and 



4*") = yuv>m/(l -wv,m). 
Similarly, using = r(l + = rCfUa), plugging (4.21) into (4.14) 

leads to 

m 1 ... fdl^}.... 



ill 
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(4.24) 



as / oo, where 



:«a-ui I 2« J 



'llV.m 

m 



^ yf2TTnu{l -U) 

r'r' r.u ^ ^ (w' + mV ( _ J_^ /I dt.. (4.25) 



'II Finally, 



5 

Substituting aU of the above into (4.12) yields (4.15). 
4.6.1 Example: F uniform 

Suppose F is the uniform distribution on (0, P]. Then f-'O^) = 
where $ is the normal distribution of mean zero, and variance 1. Also, 
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4.7. Optimal Seller Strategies 

U thi. section, by way of co.clu.icn, we brieSy outline approves to tbe con-ple- 
„ control problem, i.e., how the seller can W the mecharusrr. in order to 
optimize some syst«m-wide objective. 

Taking the above mech^sm as a given, consider the optimal strategy for the 
network manager, whose objective is to ma:dmize revenue, using ,iP) € 10,=o 
as the (feedback) control. As the spot market is governed by auctions, P . 0 
whenever the system is not full. The relevance «f the problem is during penods 
„Hen the system is heavily Wed (i.e., almost always fuU). Then, the objective .s 
equivalent to minimizing 

over all admissible controls ^ M^'l- - - the stopping time r = inf >s:P.= 
0), a..d the initial state is P. = y. The dynamic programing equation is 

0 = ^+minMM^-y), 
ds " 

for y > 0, and W{s, 0) = 0. The differential operator A is given by [20] 
A=\ [D{^)y + KM ^ + + KM] |;- 

H 1^ is a solution of the above equation, then the optimal cost is J(5,y,,-) = 
W{s y), a.d, in the classical approaches, the optimal control is obtained by per- 
forming the minimization over In this case, even when W can be solved for, 
or guessed, for each y finding the control M is in general not tractable since it 

involves polynomials of degree B\. 

There a^ a number of promising approach.™ ,o .his control problem. It is inter- 
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esting to investigate the applicability of approximation techrriques by discret.zmg 
the original problem, and solving h as a Markov-dedsion problem, in the manner 
of [53] as weU as that of (81], and compare the resulting performance with the opti- 
mal open-loop control. One should also consider some heuristic solutions based on 
related but simpler solvable problems, aad investigate the relationship of the opt- 
„>al control »ith the notion of Bro^an local time, as in [ll). FinaUy, the trad«>fis 
between optimality and computational complexity should be investigated. 
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